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ABSTRACT 

A study was conducted to identify, describe, and 
analyze the visual displays accompanying * nstructional texts in basal 
reading series. Specifically, the study reviewed 1,884 displays from 
the student textbooks, major workbooks, and teachers' editions of six 
series used from grades four through eight to answer (1) descriptive 
questions about the location, original data source, specific 
knowledge domains, types, and formats of the displays; and (2) 
instructional questions about the purposes for completing a visual 
display task, the number and types of questions about displays given 
to students, whether instruction was provided along with the 
displays, whether characteristics of displays were taught, and 
whether enrichment net ivi ties were offered. The results suggest that 
while visual displays can be used to enhance higher order 
comprehension tasks, they most often do not in basal texts. Visual 
displays were more likely to be used for drill and practice or with 
specialized skills sections in students' workbooks. There was a 
paucity of higher level questions that required students to interpret, 
and evaluate displays. (PL) 
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Introduction 

- Rationale: 

Increasing graphics/visual displays 1n texts research to deter- 
mine their effects on comprehension data base needed describing 
how visual displays used in instructional materials. 

- Purpose: 

To identify, describe and analyze visual display in Basals 

6 major basal series on 2 school levels (Int. Grades 4-6) and Junior 

High (grades 7-8) 

Study Design Description 

- Research Questions: Macro-Level Quantitative Analysis 
Divided into two broad question types: description/instruction 

Description 

Location, origin, specific domain, types, format 
Instruction 

purposes, number and types of questions about visual displays 
Instruction provided, characteristics of visual displays taught, 
enrichment activities 

- Research Question Micro Level Qualitative Analysis 

- Definition of Visual Display 

- Definition/Description of types of visual displays used 
Sequential, Quantitative, Textual Surrogates, Tables/Charts 

Procedure 

1884 visual displays in student textbook, major workbook and teachers 
edition (5 grades, 6 publishers, 4 locations) 

- Unit of analysis 

- Descriptive Questions Description 

- Instructional Question Description 

- Definition and examples of the 5 question categories 
(Extracting, Comparing, Manipulating, Interpreting, Evaluating) 

- Enrichment activities description 

- Data Analysis 

Description Analysis: Frequencies, Crosstabulation 
Statistical Analysis: Analysis of variance, breakdowns 

- Interrater Reliability 



level 

and School Level 

- Statistical Findings for 6 ANOVAs (Total Questions, Extracting, 
Comparing, Manipulating, Interpreting, Evaluating) 

Main effects: Questions 

Main effects: Enrichment Activities 

Interaction for Questions 

- Overview of Question Findings/Discussion 

Location - In depth 
Publisher - In depth 

Conclusion 

- Patterns 

Wedding rings 
Crazy quilts 

- Puzzles 

Comprehension is study skill 

Text Selection vs Skills Lesson Workbook 

(Contextual ized vs Decontextualized) 
Prior Knowledge - content - conventions 
Producing visual displays 
Developmental - Learning Styles - Metacognition 

- Potentials 

More descriptive studies - content areas - writing 

More experimental studies - Qualitative/Naturalistic studies 



Results 

- Descriptive Findings: Location 

Visual Displays/Visual Display Questions 

- Descriptive Findings: Publisher 

Visual Displays/Visual Display Questions 

- Descriptive Findings: Publisher and school 

Visual Displays/Visual Display Questions 

- Descriptive Findings: Location, Publisher, 
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INTRODUCTION 

Today I would like to report on just a piece of a larger study we did on 
visual displays. First, Til present the big picture for the total number of 
visual displays and then highlight some of the interesting findings for the 
locations of the visual displays and the number of certain kinds of questions 
that accompany the visual displays for 6 publishers and two school levels, 
intermediate and junior high. But first some information on the background, 
context, and purpose of the study. 

The study of the use and effects of visual displays of information in text 
is still in Its infancy; even though recent advances in computer graphics have 
made the use of visual displays widespread. The fact that visual displays 
frequently accompany the information in newspapers, magazines, textbooks and 
encyclopedias, and the volume of exercises on graphical comprehension in school 
materials are proof of the intuitive belief that such devices are useful. But a 
review of the literature shows thai we know little about t K e specific effects 
that graphic presentations have on comprehending text. Because of the 
ever-increasing use of graphic aics in texts, we need empirical research to 
determine the effect of graphic aids on comprehension. Before we can do this, 
however, we need to establish a data base describing how visual displays are 
used in Instructional materials. 

Our study describes a data base which was developed so that later research 
for determining the effect of visual displays on reading comprehension and 
Interest can be facilitated. The purpose cf this research was to identify, 
describe and analyze the visual displays accompanying instructional texts as 
they occur within a predominant medium of reading instruction—the basal reading 
series. The study examined visual displays in six major basal series on two 
school levels: intermediate (grades 4-6) and junior high (grades 7-8). 
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STUDY DESIGN 

Questions regarding visual displays in basal reading textbooks were divided into 
two broad question types - description and instruction. Description questions 
asked about the location, original data source, specific knowledge domains, 
types, and format. Instructional questions asked about purposes for completing 
a visual display task, number and types of questions about visual displays given 
to students, whether or not instruction was provided along with the visual, 
instructional purposes, whether characteristics of visual displays were taught, 
and whether guided practice, and enrichment activities were offered. These 
questions attempted to discover the answers to "what is available in basal 
reading texts concerning visual displays?" 

Besides this macro level quantitative analysis, we also performed a micro 
level qualitative analysis of visual displays. We selected one publisher and 
one kind of visual display (charts and tables) at grade 4 and grade 7 for an in 
depth look at instruction. A sub study then compared a second publisher's 
instruction of charts and tables at grade 7. Our goal was to better understand 
patterns of instruction as exemplified by charts/tables. 

Based upon these concerns, we asked the following questions in our 
research: 

I. Descriptive Questions 

1. Where do publishers place visual displays? 

2. From what data sources do publishers derive visual displays? 

3. From what specific knowledge domains do publishers derive visual 
displays? 

4. What kinds of visual displays do publishers present to students? 

5. Format Evaluation: Questions asked about each visual display. 
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a. Is the display sufficiently complete to allow a student to 
complete the task required? 

b. How clearly is the information presented? 

c. Is there sufficient precision in the underlying numerical scale 
to allow a student to infer specific numbers? (That is, are 
there visual displays activities which require precision when 
they allow only for approximation?) 

d. How appropriate is the visual display for the maturity level of 
the intended audience? 

II. Instructional Questions 

6. What purposes do publishers suggest/imply for having students complete 
visual display activities? 

7. What kinds of questions accompany visual displays? 

8. How many of each kind do publishers ask? 

9. Are there any enrichment activities to accompany the visual display 
lesson? 

10. What is the nature of the instruction provided for the visual 
displays? 

What is the instructional purpose cf the visual display? Does the 
instruction bring attention to the characteristics, terminology, and relevance 
of the visual display? Is there evidence of guided practice? 

For the purposes of our presentation, visual displays will be defined as 
aids which clarify, simplify, summarize, overview, and bring life to prose. 
Following is a description of the types of the visual displays analyzed for the 
purposes of the research: 

A sequential graph is a lineal, temporal form of organization. Examples 
of sequential graphs are simple and multiple timelines, flow charts, 
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hlerarchial-organizational charts, genealogical charts, process charts, and 
sports tournament charts. 

Quantitative graphs facilitate the comparison of areas, quantities, 
numerical values, and other quantitative data. They often clarify important 
facts, generalizations and relationships which are not readily apparent in 
tabular data. Included under this category are line, bar, pie, and plctographs. 

Textual surrogates are schematic diagrams, illustrated directions, 
cross-section diagrams (profiles) and directional diagrams. Included also in 
this category are symbols used for traffic, music, mathematics, language (such 
as the hand symbols for ASL), and ideographs for written language. 

Tables and charts are combined into one category. Tables are an orderly 
arrangement of concrete numerical information in vertical columns and horizontal 
rows. Examples include time management schedules, transportation schedules, air 
distance tables and mileage tables. A chart shows organization through words, 
symbols, and/or numbers. The last category includes those visual displays which 
are highly verbal in appearance. Included are verbal charts necessary for 
business— sales ads, classified ads; for library skills—dictionary pages, 
indices, tables of contents, glossaries, encyclopedias, title-author-subject 
cards; and for survival skills— phone books, movie and television schedules, 
etc. 

PROCEDURE 

A total of 1884 visual display entries were encountered as we examined the 
student textbook, major workbook, and teachers 1 edition across five grades, 4th 
through 8th. Each visual display was recorded as a separate entry, even though 
accompanying instructions or questions might be shared between two entries. 



ERLC 



8 



5 



Unit of Analysis 

In a study of this type, there are no subjects, as such, to use as the basic 
unit of analysis, but we conceptualized each visual display as a 11 subject" and 
the basic unit of analysis for both statistical and qualitative analyses. The 
quantitative analyses also Include instruction information given to teachers in 
the Teachers 1 Edition of the basal. 

I. Descriptive Questions 

1. Locations were described as "in the student's text as a skills lesson" 
(decontextuallzed) , "in the student's text as a narrative or expository 
selection" (contextual ized), in the teacher's edition only (as an 
Introduction, demonstration, or explanation), or in a main workbook. 
The page number of the page containing the visual display was recorded 
regardless of whether the visual display was located in the text, 
teacher's edition, or major workbook. 

2. The content was described globally in terms of its orientation and 
source of data: that 1s if it dealt with current factual knowledge, 
historical factual knowledge (more than ten years ago), knowledge based 
on realistic fiction (there was no evidence that the facts were 
genuine) and upon fantasy (no evidence of factual authenticity). 

3. A content analysis was made of a sampling of visual displays and it was 
decided that the knowledge domains of the visual displays were similar 
to those covered by the Dewey Decimal System. Therefore, a similar 
system of categorization was used (see Appendix A). 

4. The genre or type of visual display was categorized according to 
format. The design of the Instrument was based somewhat on Fry's 
Taxonomy of Graphs (1981), although changes occur 1n category labels: 
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Fry's "lineal" graphs become "sequential" graphs and his "pictorial" 
graphs become "text surrogate" in this research; in organization: 
Fry's "hypothetical" becomes "test surrogate" 1 

5. We evaluated each visual display in terms of completeness , 
legibility , intention , and appropriateness , A second opinion was 
sought — judgments were substantiated with an additional analysis by 
two colleagues. The graph was judged to be incomplete if the omission 
or misplacement of information rendered the questions about the graph 
difficult to answer. A cluttered or obscure graph contained 
information that distracted or interfered with question-answering 
because there was too much unnecessary information, the coloring 
inappropriate so as to distract or the print was unnecessarily large or 
small. Also a graph was considered confusing if the symbols were not 
clearly differentiated from each other. A third critique was the fact 
that some graphs required precise answers from the reader, but the data 
itself was not presented precisely so that the reader would ">ve to 
estimate an answer. A final critique was the inappropriateness to 
grade level of a visual display; for example, if a lesson on career 
awareness was to be undertaken, then it is logical that the materials 
be mature in tone. 

II. Instructional Questions 

6. We categorized the purpose for including the visual display in the 
text. If its purpose was to aid the reader in vicualizing or imagining 
information, then there were no real accompanying questions about the 
visual display, and the text may or may not have referred directly to 
it. If its purpose was to aid the reader to extract information then 
there were specific accompanying questions so that the reader might use 
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the Information in the visual display to answer separate questions. 
The student might be asked to fill in information in a partially 
completed visual display, or s/he might be asked to criticize the 
visual display in terms of its accuracy or its presentation. Finally a 
visual display might be provided solely f or the purposes of assessment . 
The kinds of questions which accompany the visual display were then 
categorized 1n terms of their requirements on the part of the reader. 
An extracting data question asked the reader to use the information 
from the visual display to answer a question which doesn't require the 
reader to compare the data with other pieces of data. A comparing 
question requires the reader to use two or more pieces of information 
to answer a question 1n a visual display. A manipulative question 
requires the reader to actually perform a mathemagenic computation in 
order to answer the question. An interpreting question requires the 
reader to utilize several pieces of information to make a prediction, 
notice a trend, or justify a condition. An evaluative question 
requires the reader to summarize the effectiveness of the graph in 
terms of its purpose, accuracy, and the skills needed by the reader to 
understand the graph. We asked about the number of each kind of 
question that accompanied visual displays. 

We then observed the nature of the instruction . We judged the 
existence, degree, and type of instruction which accompanied the visual 
display. We decided whether Instruction had occurred: we asked 
whether the instruction mentioned the characteristics of the visual 
display (1n terms of appearance, purpose for or use of the visual 
display), and/or the specialized terminology connected with the visual 
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display (such as identifying labels). Third, we sought evidence of 
guided practice (where the teacher actually "walks through" the lesson 
with the students, relating the exercise to real -life situations. We 
also investigated the extent to which enrichment activities were 
included for visual displays. 
Description of the Question/Task Categories 

We categorized the kinds of questions or tasks which accompany the visual 
display in terms of what they required students to do. We developed 5 
categories of questions: Extracting, Comparing, Manipulating, Interpreting, and 
Evaluating. The following definitions and examples from Publisher F for grade 4 
and grade 7 should help clarify the criteria used to categorize the questions. 

1. An Extracting question requires the reader to look at one piece of data. 

If a student can answer a question by looking at the legend and looking at 
one category on a visual display, for instance, it is an Extracting data 
question. 

Example: How much water would you use to make two servings of rice? 

2. A Comparing question requires the reader to use two or more pieces of data 
to answer a question asking for similarities, differences, or analysis. If 
a student can answer a question by looking at and comparing two numbers, for 
instance, it is a comparing question. 

Example: During what two months are temperatures lowest in Cairo? 

3. A Manipulating question requires the reader to perform a computation in 
order to answer the question. 

Example: How much less was spent in 1979 than was spent in 1980? (the 
student must compare 2 numbers to subtract.) 
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4. An Interpreting question requires the reader to use several pieces of 
information to make a prediction, identify a trend or patterns, justify a 
condition, or draw conclusions. 

Example: How will the Big Dipper change from now until 100,000 years from 
now? 

5. An Evaluating question requires £he reader to judge the effectiveness of 
the visual display in terms of Its purpose, accuracy and the skills needed 
by the reader to understand the visual display. 

Example: Write two sets of directions for finding the pirate 

treasure. . .give your partner a direct and easy route to follow. 
Give the other person a more difficult route. 

For the purpose of the analysis, we considered E/tracting questions to be on 
a literal, lower level of difficulty, Comparing and Manipulating questions to be 
on a higher level oV difficulty, and Interpreting and Evaluating questions to be 
on the highest level of difficulty. However, we realize that level of 
difficulty 1s often a function of the reader's prior knowledge of subject matter 
and characteristics of the visual display, the clarity of the question, the 
quality of the visual display, and the judgment of the person categorizing the 
questions. But, other things being equal, we hypothesizad sur'i an order of 
difficulty. 

Description of Enrichment Activities 

Enrichment Activities are follow-up, supplementary tasks for visual 
displays. They may be oral or written tasks, and teacher or student generated. 
Teachers are sometimes instructed by the teachers 1 manual to reproduce the 
visual display on the blackboard and/or to identify and describe the visual 
display from the textbook(s). Sometimes the teachers 1 edition suggests how the 



ERLC 



13 



10 



teacher should elicit responses, but all visual displays are produced by the 
student. Students sometimes perform enrichment activities as an individual or 
as a member of a group. For this analysis all types of enrichment activities 
were ccl lapsed into one category. 
D ata Analysis 

Descriptive Analysis . Frequency and cross tabulation analyses were used for the 
descriptive questions concerning visual displays (location, sources, specific 
domains, kinds of visual displays, and format). Breakdown analyses were used 
for the instructing questions (location, number of questions) of each type 
accompanying visual displays, and enrichment activities). 
Statistical Analysis . For statistical analysis, we performed analysis of 
variance for each of the 5 question types and their combined total, makir.j a 
total of 6 separate ANOVAS: Extracting, Comparing, Manipulating, interpreting, 
Evaluating, and Total Questions. The 3 factors for each ANOVA were Publisher (6 
levels: A,B,C,D,E,F), Location in the basal reading materials (4 levels: 
Skills Lessons in the student text, Text Selections, both narrative and 
expository, in the student text, Teachers' Edition, and Workbooks) ar.d School 
Level (2 levels: Intermediate (grades 4-6) and Junior High (grades 7-8). The 
The dependent measure was the. number of questions in each category for each 
visual display. 

The design for the enrichment activities was a 2 way analysis of variance: 
Publisher (sane 6 levels) by School Level (Intermediate vs. Junior High). 
Interrator Reliability 

A check for interrator agreement was carried out for each category based on 
the criteria we established for the definition. The two coders selected a 
random sample of 10 percent of the entries for each question category and 
enrichment activity and then judged each entry independently. The number of 
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agreements divided by the number of disagreements yielded an interrator 
agreement of 85% for the combined question types and 90% for the enrichment 
activities. But, other ^ings being equal, we hypothesized such an order of 
difficulty. 

RESULTS 

Descriptive Findings: Location 

Visual Displays . We can see from Figure 1A and Table 1A that when we collapse 
across publishers and school level, about three-fourths of the approximately 
2000 visual displays (N=188) are located in basal materials for the student 
(74%) and about one-fourth are located in the Teachers' Edition (26%). Of the 
student materials, most visual displays are located in the major workbook (37%) 
with the remainder divided rather unevenly between skills lessons and text 
selections. Note that twice as many visual displays are found in skills lessons 
(23%) as are founJ in the text selection (13%). It is also noteworthy that 460 
of the 1884 visual displays (23%) are found in teachers' editions which 
typically suggest that teachers reproduce them on the chalkboard (or from a 
master) so that students may or may not see them. 

Visual Display Questions . A similar pattern exists for the questions 
accompany. ng visue' displays. Three fourths of questions are located in student 
materials (73%) and one fourth in the teachers' edition {27%). Most of the 
questions are found in the major workbook (47%) — almost half of the questions 
— , the fewest are found in the text selection (3%), and about one fourth are ' 
found in the skills lessons. As you can see from Figure IB and Table IB 
Y vever, there is a larger percentage of the total questions located in the 
major workbook (47%) than is the case for the percentage of visual displays 
(37%) and a smaller percentage of questions located in the text selection (13%) 
than is true for visual displays (3%). 
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Descriptive Findings: Publisher and School Level 

Visual Displays : Figure 4A indicates that 5 of the 6 publishers look quite 
similar concerning their percentage of the total visual displays investigated 
(N= 1884*. Publisher D accounted for almost one fourth of total (23%) while the 
rest ranged from 14% to 16%. 

Visual Display Questions . Figure 4B shows that a different pattern emerges for 
the total questions accompanying those visual displays. Publisher D still 
accounts for about one fourth of thj questions (26%), but Publisher F, for 
instance, accounted for only 10% of the total questions vs. 16% of the total 
visual displays, while Publisher E accounted for 22% of the total questions vs. 
only 16% of the total visual displays, a 6% difference for Each. Publisher C 
had a larger percentage of questions than visual display (21% vs. 16%) while 
Publishers A and B had smaller percentages of questions than visual displays 
(12% vs. 14% and 9% vs. 15%). The analyses show that there is not always a 
match between the number and percentage of visual displays and the instruction 
(1n the form of questions) that is provided for the visual displays for the six 
publishers. Some publishers provide fewer visual displays but a great deal of 
instruction for them while others provide more visual displays but little/or no 
instructions/questions for them. 
Descriptive Findings: Publisher and School Level 

Visual Displays . As is indicated ii, Figure 6A, except for Publisher D (14%), 
there is little difference between publishers on the intermediate level 
(Publishers A and F = 8% each and Publishers B, C, and E = 9% each). The same 
is true for the junior high level (Publisher A=6%, Publishers B and E = 7%:, 
Publishers C and F = 8%, and Publisher D - 9£). The 5% difference for Publisher 
D between intermediate and junior high shows that more emphasis is placed at the 
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intermediate level in comparison to the other publishers and in comparison to 
the junior high level within publishers. 

Visual Display Questions . Figure 6B shows that there is more variation among 
publishers for both school levels for the percentage of total questions in 
comparison to the number of visual displays. Publisher D leads with the highest 
percentage 16%, followed by Publishers C and E at 11% and Publishers A, B and F 
at 6% on the intermediate level. On the junior high level, Publishers C, D, and 
E each account for 10%, Publisl.er A for 5%, Publisher D, 4% and Publisher B at 
3%. It Is interesting that the percentage is higher for questions than for 
visual displays for Publishers C,D, and E but lower for Publishers A, B, and F. 
This seems to indicate that more instruction is provided for visual displays by 
Publishers C, D, and E. 

Descriptive Findings for lr:ation, Publisher, and School Level 
Visual Displays . Table 2A show? that collapsed across publishers, 72% of the 
visual displays on the Intermediate level are located in student materials while 
76% on the Junior High level are located in student materials. This amounts to 
a slight increase for student materials and a decrease for teachers' edition as 
locations for visual displays on the Junior High level. The biggest difference 
for school levels is the percentage for visual displays found in the skills 
lesson location. Only 19% of the visual displays on the intermediate level are 
found in skills lessons while 29% are found in skills lessons on the junior high 
level, an increase of 10%. There are slight decreases in the percentages for 
the text selection (2%) and major workbook locations (3%) for junior high. When 
we look at individual publishers, however, we see a great deal of variation for 
location for intermediate and junior high levels. Publisher D accounted for 25% 
of the 1060 visual displays on the intermediate level and 20% of the 824 on the 
junior high level, indicating a 5% decrease at the junior high level while 
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Publisher F accounted for 14* of the total intermediate visual displays but 18% 
of the total junior high visual displays, a 4% increase at the junior high 
level. Looking at the specific locations, we see that publishers differ in what 
they do for the intermediate and junior high levels. Of the visual displays 
found In the major workbook locations, on intermediate and junior high levels, 
Publisher D accounts for 19* on each level. Publisher D, however, accounts for 
32% on the intermediate level (about one third) and 29% on the junior high level 
while Publisher E accounts for only 12% on the intermediate level and only 9% on 
the junior high level. Publisher D has 20% of all the visual displays at the 
intermediate level In contrast to 1% at the junior high level, a difference of 
19%. Publisher F has 14% of the intermediate level visual displays, but 24% of 
the junior high ^evel visual displays, a difference of 10%! For the skills 
lesson, Publisher C has a 4% decrease from the intermediate to the junior high 
level while Publisher F has a 4% increase from the intermediate to the junior 
high level. The same situation exists for the text selection location. 
Publisher E has an 11% decrease from intermediate to junior high levels while 
Publisher F has an 8% Increase from intermediate to junior high levels. The 
same variation exists within publishers for both visual displays and questions 
accompanying visual displays. Publisher F has a total of 302 visual displays 
but only 209 visual display questions. Of the 302 visual displays for the major 
workbook location, 18% are on the Intermediate level and 11% on the junior high 
level, of the 209 visual display questions, 35% are on the intermediate level' 
and 28% on the junior high level. For the teachers' edition location, 14% of 
the visual displays are on the Intermediate level and 16% on the junior high 
level, while 6% of the visual display questions are at the intermediate level 
and less than 1% at e junior high level. 
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Clearly, publishers have quite different philosophies about where to put 
visual displays and questions accompanying visual displays for each school 
level. This is true between publishers and amorg publishers. 

STATISTICAL FINDINGS 

We have grouped together the statistical findings for the 6 separate ANOVAS 
performed for Total Questions, Extracting, Comparing, Manipulating, 
Interpreting, and Evaluating questions. The analyses revealed significant main 
effects for Publisher and Location and significant 2 -way interactions for 1) 
Publisher and Location, 2) Publisher and School Level, and a significant 3-way 
interaction fort) Publisher and Location and School Level. The ANOVA for 
Enrichment Activities revealed a significant main effect for Publisher, but no 
significant interactions. These data are displayed in Tables 2B, 3B, and 18. 
Main Effects For Questions/Tasks 

Because significant Interactions were present for all three factors 
(Publisher, Location, School Level), it is difficult to interpret the findings 
for main effects. The data indicates that there are indeed, significant 
differences for Publisher and Location but we must remember the dependencies and 
Interactions among all three factors. 

The ANOVAs resulted in 4 significant main effects for Location (Total 
Questions, Extracting, Comparing, p-.OOl and Evaluating, p=.020) and Publisher 
(Total Questions, Extracting, Manipulating, and Evaluating, p = .001, and 
Comparing, p s .011). r 
Main Effects For Enrichment Activities 

We found significant main effects for Publisher (p = .001). These data 
can be seen on Tables 17 and 19. What 1s most striking is the low mean number 
of Enrichment Activities for Publishers and School Levels. 
Interactions For Questions/Tasks 
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The ANOVAs resulted in 9 significant interactions. For Total Questions we 
found 2 way interactions for Publisher and School Level, Publisher and Location, 
and School Level and Location (p ■ •001). In addition there were 2 way 
Publisher and School Level interactions for Extracting Questions (p ■ .015) and 
Interpreting (p = .02) and Publisher and Location interactions for Extracting (p 
- .001), Manipulating (p = .009) and Evaluating (p ■ .02). The data for the 2 
way interactions are displayed in Tables 13-15. Table 16 shows that we found a 
significant 3 way interaction (Publisher x Location x School Level) for Total 
Questions (p = .001). 
Summary of Question/Task Findings 

It is clear from the data that there are indeed significant differences 
with respect to the number and kinds of questions/tasks that students are asked 
to complete when they use data from visual displays as a function of publisher 
location in basal materials, and school level. There does appear to be patterns 
that hold up across publishers, locations and school levels. We know that 
publishers ask students more Extracting and Comparing questions than 
Interpreting, Evaluating or Manipulating questions. A second pattern is (a) the 
most preferred location for questions/tasks accompanying visual display is the 
Workbook followed by (b) the Teachers 1 Edition as the next preferred location. 
The least preferred location is (c) the Text Selection location. The third 
pattern indicates that more differences exist between publishers at the 
Intermediate than at the Junior High level in both location and question total/ 
For Total Questions, Publishers A, D, E, and F look rather similar while 
Publisher C (who asked the most questions) and Publisher B (who asked the fewest 
questions) looked quite different. 

However, there seem to be few reliable patterns when we look closely at 
publisher behaviors (both within and between) at Intermediate and Junior High 
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levels and at the various locations for the 5 specific question categories, 
Publisher C vs. Publisher B. This fact, no doubt, explains why we found a 
significant 3 way interaction. In general, there seem to be as many 
inconsistencies as there are consistencies and as many questions are raised as 
are answered about questions/tasks accompanying visual displays. 

Location . As we see from Table 3B, there were significant main effects for 
4 of the 6 question types (Total Questions, Extracting, and Comparing, p = .001 
and Evaluating, p = .02). The data shows that publishers place questions 
accompanying visual displays most often in workbooks (8.51), followed in 
descending order by the Teachers' Edition (6.03), Skills Lesson and Text 
Selection locations, (4,24 and 4.21). If Skills Lessons and Text Selection are 
combined, students see about the same number of visual display questions in 
their student text as they do in their workbooks. It is interesting that so f6w 
questions accompany visual displays that are related to the narrative and 
expositive basal selections. The tendency seems to be to ask questions about 
visual displays in Skills Lessons or Workbooks that are decontextual ized and 
unconnected to specific text selections. It is also clear that many visual 
display questions appear only In the Teachers 1 Edition and are not in the 
student text. We can wonder whether students are missing an opportunity to 
answer many of these visual display questions if teachers choose not to use 
them; we also wonder if students believe visual display questions in workbooks 
are less important, more trivial than tnose in their basal text or the Teachers 1 
Edition. 

Student perception of the importance of visual displays/questions as a 
function of location for Total Questions showed that in the Text Selection 
location, 3 publishers asked no questions (A, C, and F) while 3 publishers asked 
some (B, D, and E). This was the least popular location to place visual display 
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questions. The Teachers' Edition was the second most popular location and the 
Skills Lesson the third most popular location. The Intermediate level tends to 
have more visual display questions 1n the Teacher's Edition than doss the Junior 
High (6.99 vs. 4.88) while the Junior High level tends to have more visual 
display questions in the Workbook than does the Intermediate level (8.78 vs. 
7.58). Similar patterns exist at both Intermediate and Junior High levels for 
the Skills Lesson (Intermediate = 4.31 and Junior High 4.17) and Test Selection 
(Intermediate 4.22 and 4.56). 

Table 4B reveals that Publisher C emphasizes the major workbook and 
Teachers' Edition as locations for question, de-emphasizes Skills Lessons and 
Ignores the Text Selection locations. The intermediate level is preferred over 
the junior high level for questions, appearing only in the Teachers' Edition 
while for Workbook questions, the opposite holds true. Publisher F has a 
different pattern with about half as many workbook questions and Teachers' 
Edition questions as Publisher C for a stronger emphasis on Skills Lesson 
location and weaker emphasis on the Teachers' Edition than Publisher C. 

For Extracting Questions, Table 4B Indicates that at the Skills Lesson 
location, Publisher D asks the most at the Intermediate level (5.49) while 
Publisher B asks the fewest at the Intermediate level (2.70). Publisher E asks 
the most questions at the Junior High level (5.46) and Publisher C asks the 
fewest questions (1.64). At the Text Selection location 3 publishers ask none 
(A, C, F). Publisher E asks the most questions at the Intermediate level (5.00 
but asks none at the Junior High level, and Publishers D and B ask slightly more 
questions at the Junior High than at the Intermediate level (B = 2.00; 3.00 and 
D = 4.50; 4.88). At the Teachers' Edition location, 4 publishers have more 
questions at the Intermediate than Junior High level (C, D, E, and F ) while A 
has more questions at the Junior High level than the Intermediate (2.90, 4.50). 
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Publisher D emphasizes Skills Lesson and Text Selection locations more than does 
Publisher C who prefers the Teachers 1 Edition and Workbook locations. Both ask 
more questions at the intermediate level than the junior high level. 

The Comparing ANOVA results were similar to those for the Extracting 
category. The least popular location was Text Selection (Publishers A, C, and F 
had none at all) but there was the most variation here. The Workbook is the 
most popular location for all publishers for Comparing questions and the second 
most popular location varies: Publishers A, B, and C prefer the Teachers 1 
Edition, Publisher E prefers the Text Selection location and Publishers D and F 
prefer the Skills Lesson location. Five publishers (B, C, D, E, F) place more 
visual display questions at the Skills Lesson location for the Intermediate 
level than Junior High. At Text Selection, Publisher B asked no questions at 
the Junior High level but Publisher D asked twice as many (4.00 vs. 2.10) and 
Publisher E asked three times as many (10.00 vs. 3.00) on the Junior High level 
as on the Intermediate level. At the Workbook location, all but Publisher F ask 
more at the Junior High than the Intermediate level. Except for Publisher C and 
D, the publishers have similar patterns. 

For the Evaluating question category, the Publisher and Location 
Interaction was significant (p = .02). Overall, Publisher C asks the most 
Evaluating questions (4.11) and Publisher E the fewest (1.34). The remaining 
publishers ask about the same amount of questions. For the Skills Lesson 
location, Publishers B, E, and F look alike for both School Levels (2.08, 1.75;" 
1.67, 1.67; 1.00, 1.00). Publisher A and C ask none at the Junior High level, 
Publisher a asks the most at the Intermediate level (3.25) and Publisher D asks 
the most at the Junior High level (2.00). For Text Selection, Publishers C, 
and F have none at all, Publisher B has questions only for Junior High while 
Publisher E has them only at the Intermediate level. For Teachers 1 Edition 

23 
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Publisher C asks the most for Intermediate level (5.00) and Publisher E the 
fewest (1.13). Publishers C and D ask more for Intermediate than for Junior 
High levels and Publisher A and B have none for Junior High and Publisher F has 
none for either level. All publishers have some Evaluative questions in the 
Workbook location. Publisher B asks the most questions (5.67 for Intermediate 
and 4.29 for Junior High). Publishers B and D ask more for the Intermediate 
level while Publishers C and F ask more for the Junior High level. Publishers 
tend not to put evaluating questions in the Skills Lessons or Text Selection 
location but rather put them in the Teachers 1 Edition or Workbook locations. 
Publisher . Table 2B reveals that then? were significant main effects for all 
question types (Total Questions, Extracting, Comparing, Manipulating, and 
Evaluating, p=.001) except Interpreting. In general, publishers did not ask 
many of the higher level Interpreting questions. We can see from Table IB that 
overall, publishers averaged about 6 questions per page for each visual display; 
however, there were differences among publishers. The rank order for the 
average number of question accompanying visual displays from the most to the 
least 1s Publisher C (8.86) Publisher D (7.08) Publisher A (6.43) Publisher E 
(5.97) Publisher F (5.37) Publisher B (4.81). Publisher C asked twice as many 
questions as Publisher B. Publishers A, D, E, and F look very much for the 
total number of questions per page asked about all visual displays. As is clear 
from Table 4B, there is a great deal of variation within, as well as between 
publishers, depending on the type of question/task accompanying the visual 
display, Its location in the basal materials, and the school level (Intermediate 
or Junior High). 

If we rank order the 5 question types from the most asked to the least 
asked for all publishers and across locations and school level, we find in 
descending order Extracting (4.84) Comparing (4.22) Interpreting (2.58) 
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Evaluating (2.54) Manipulating (2.10). There is a great deal of consistency 
between publishers for Extracting and Comparing questions (many questions 
accompanying the visual displays) and for Interpreting, Evaluating, and 
Manipulating questions (few questions accompanying the visual displays). It may 
be that publishers ask few manipulating questions because they assume students 
will get opportunities to do manipulative tasks for visual displays in 
mathematics lessons. It 1s not clear why publishers ask for few of the 
higher-level Interpretive and Evaluative questions, even though these require 
critical thinking, strategies for high level processing, and prior knowledge of 
subject matter and visual display characteristics. 

For the Total Question category, half of the publishers asked more visual 
display questions on the Intermediate level than on the Junior High level: C 
(9.95, 7.81), E (6.71, 5.88), B (4.97, 4.63) while the remaining 3 publishers 
asked more on the Junior High level than on the Intermediate level: A (7.68, 
6.48), D (7.49, 7.23), and F (6.29, 5.55). Across School Levels, all publishers 
prefer the Workbook location for their visual display questions. 

For the Extracting question category, Publisher C asks more at the 
Intermediate level than the Junior High level (6.7; 4.6) while the reverse is 
true for Publisher A (4.5; 5.9). Publisher F is similar to Publisher A and 
Publisher E 1s similar to Publisher C in their preference for Intermediate or 
Junior High levels while Publishers D and B have approximately equal numbers of 
questions for each level . 

For the Comparing question category we find a pattern similar to the 
Extracting question category: Publisher C asks the most questions (5.20) and 
Publisher B the fewest (3.53) and the rest look rather alike (A = 3.66, D = 
4.51, E = 3.71, and F * 4.13). 
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The Manipulating question category like the Comparing category had only a 
Publisherx Location interaction that was significant (p = .009). For this 
category, Publisher A asked the most questions (3.30) and again Publisher B asks 
the fewest (1.09). Publishers C and F have similar patterns (2.78, 2.70) and 
Publishers D and E (1.81, 1.88). When we look at publishers and locations, we 
see a crazy quilt. There seems to be no patterns for publishers at the 
different locations. Skills Lesson is the most preferred location for 
Publishers E and F and least preferred for Publisher C. Only Publishers B and D 
ask any questions for Text Selection and Teachers' Edition locations and the 
Workbook location 1s most preferred by Publisher a and least preferred by 
Publisher B. Publishers vary according to School Level and Location since 
Publisher F asks more questions for Intermediate level for the Workbook location 
than for Junior High, but the opposite is true for Publisher C. However, 
Publisher F asks more questions at the Junior High level than at the 
Intermediate level for the Skills Lesson location while the reverse is true for 
Publisher D. 

For the Interpreting question category, there was a significant Publisher 
x School Level Interaction (p = .04). Two publishers asked more questions at 
the Junior High than at the Intermediate level (E = 1.69, 2.55, F = 2.23, 3.68), 
two publishers asked more at the Intermediate level (C = 4.83, 2.14; B = 2.33, 
1.00), and two publishers asked about the same for both levels (A = 2.31, 2.17; 
D = 1.67, 1.00). The average overall for Interpreting questions was 2.58 with* 
Publisher C asking the most (3.38) and Publisher D the fewest (1.33). Publisher 
A prefers to place Interpreting questions in the Workbook, Publishers B and E in 
the Skills Lesson, Publishers C and D 1n the Teachers 1 Edition and Publisher F 
1n the Text Selection location. Publisher B uses Text Selection only for the 
Junior High level (1.00^ but Publisher F uses 1t only for thp Intermediate level 
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(4.00). It is Interesting that Publisner F uses the Skills Le^on and Workbook 
locations for more questions at the Junior High level than Intermediate level, 
and has none 1n the Teachers' Edition. 

School Level . There were no significant main effects for School Level, 
but we cannot conclude that there were no differences within and between 
publishers and locations for all 5 question types and total questions as is 
dear from Tables 5-10. For instance, within publishers, differences between 
the Intermediate and Junior High levels exist: Publisher C (Intermediate = 
9.81, Junior High = 7.81) had a difference of 2.00 in the average number of 
visual display questions per page for Total Questions and a 2.66 difference for 
Interpreting questions (4.80 vs. 2.14) while Publisher A (Intermediate = 5.29, 
Junior H ^h = 7.79) had a difference of 2.50. Publishers did not seem to vary 
much 1n the number of Manipulative question* asked at Intermediate and Junior 
High levels. At the Intermediate level Publisher C asked over twice as many 
total questions (9.81) as did Publisher B (4.86), a di • erence of 4.95. At the 
Junior High level, Publisher A averaged 7.79 total questions while Publisher B 
averaged 4.73, a difference of 3.05 questions. Similar patterns of differences 
exist for the 5 specific question types. 

Although there were few differences within locations as a function of 
School Level for Lxtracting questions, there were large differences fjr the 
remaining question types. 

Patterns of differences and Inconsistencies exist between locations. For ' 
Instance, at the Intermediate level, we find an average of 7.58 total questions 
for the Workbook location, but only 4.31 for the Skills Lesson location, a 
difference of 3.27 questions. At the Junior H h level we find 8.78 but only 
4.17 for the Skills Lesson, a difference of 4.61 questions. Similar patterns of 
differences exist foi* the other question types. We can conclude, therefore, 
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that whilfc there were no significant main effects for School Level , when we 
tease apart what publishers do at different locations for different question 
types, there are definite differences between the Intermediate and Junior High 
levels. 

CONCLUSIONS 

Visual displays lend themselves quite conveniently to higher * 
order comprehension tasks. Indeed, the whole point of displaying 
•information visually is to highlight relationships among facts 

that might be more obscure in a verbal presentation. Therefore, 
it would seem likely, that visual displays frequent the 
exposition or "natural text" in the basal s. This is not the 
case, as we have suggested. Visual displays are more likely to 
to be used for drill and practice or for specialized skills 
sections in the pupils 1 textbooks. We are concerned that 
students may not be exposed to the kinds of displays which are 
most effective in highlighting exposition. We even more 
concerned about the paucity of higher level kinds of questions 
which requite students to interpret and ^ jluate the displays. 
Therefore, we hope that decisions about the design of better 
textbooks are sound ones and are based upon research more than 
upon intuition. 
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I. Descriptive Questions 

Where do publishers place visual displays? 

2. From what data sources do publishers derive visual displays' 

3. From what specific knowledge domains do publishers derive visual 
displays? 

4. What kinds of visual displays do publishers nr^ent to students? 

(5j Format Evaluation: Questions asked about each visual display. 

a. Is the display sufficiently complete to allow a student to 
complete the task required? 

b. How clearly is the information presented? 

c Is there sufficient precision in the underlying numerical scale 
to allow a student to infer specific numbers? (That is, are 
there visual displays activities which require precision when 
they allow only for approximation?) 

d. How appropriate is the visual display for the maturity level of 
the intended audience? 

II. It.atructional Questions 

6. What purposes. do publishers suggest/imply for having students complete 
visual display activities? 

What kinds of questions accompany visual displays? 
How many of each kind do publishers ask? 

Are there any enrichment activiti <s to accompany the visucl display 
lesson? 

What is the nature of the instruction provided for the visual 
displays? 

What is the instructional purpose of the visual display? Does the instruction 
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LOCATION OF V|SUAL DISPLAY QUESTIONS 
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TABLE 1A 



. D ^I!IS!I I ?? n 2cc VlSU ^ °iF LAYS F0R STUDENT AND TEACHER BASAL MATERIAL 
LOCATIONS ACROSS PUBLISHERS AND SCHOOL LEVELS (Grades 4-6 and 7-8) 



Location 



Avg. per Avg. Per 
Number % Of Total Publisher Grade 



Student Materials 
Textbook Total 



Skims Lessons 
Text Selection 
Checkpoint 
Major Workbook 



70S 



371 



141 



28 



440 

247 
18 
689 



(DO 
IX 
37% 



49 
4 

138 



Iff 
10 

28 



Total Student Material 



1394 



74% 



279 



56 



Teacher Materials 
Teacher's Edition 

GRANO TOTAL 



490 
1884 



100X 



98 

377 



20 
76 



TABLE 4A 

LOCATION OF TOTAL QUESTIONS ACCOMPANYING VISUAL DISPLAYS ACROSS PUBLISK-PS AND 
SCHOOL LEVELS {INTERMEDIATE, GRADES 4-6 ANO JUNIOR HIGH GRAOES 7-8) 



LOCATION 



NUMBER 



% OF TOTAL 



AV. PER PUBLISHER 



GRADE 



Student Materials 

I BgBp TQiiJ — 
Skills Lessons 
Text Selection 
Major Workbook 

Total Student 
Material 



_S2B_ 



93 



19 



493 

65 
1026 



1584 



ill 
73X 



82 
11 
171 



264 



16 
2 
34 



53 



Teacher Materials 
" Teacher Edition 



GRANO TOTAL 



592 



2176 



loot 



99 
363 



20 
73 
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TABLE 2A 

DISTRIBUTION OF VISUAL DISPLAYS FOR STUDENT ANO TEACHER BASAL MATERIAL LOCATION FOR INTERMEDIATE (GRAOES 4-6) ANO 
JUNIOR HIGH (GRADES 7-8) LEVELS ACROSS PUBLISHERS 



Location 




Numbers 


1 of Total 


Avg. 


Per Pub. 


Avg. 


Per Grade 




Total 


Int. 


Jr. High 


Int. 


Jr. High 


int. 


Jr. High 


Int. 


Jr. High 


Student Materials 




















Textbook Total 


705 


36S 


340 






61 


57 


12 


11 


Skills Lesson 


440 


Z05 


235 


-* 




34 


39 


7 


B 


Text Selections 


247 


149 


98 




121 


?5 


16 


5 


3 


Checkpoint 


16 


11 


7 


It 












Major Workbook 


689 


402 


287 


381 


351 


67 


46 


10 


10 


Total Student Material 


1394 


767 


C2S 


721 


761 


128 


104 


26 


21 


Teacher Materials 




















Teachers Edition 


490 


293 


197 




<£> 


49 


33 


10 


67 


GRAND TOTAL 


1884 


1060 


824 


1001 


1001 


177 


137 


35 


27 



TABLE 3A 

NUMBER AND 1* OF VISUAL DISPLAYS FOR 6 PUBLISHERS, 5 LOCATIONS, AND 2 SCHOOL LEVELS— INTERMEDIATE 
(GRAOES 4-6) ANO JUNIOR HIGH (GRADES 7-8) 



Location 







A 




8 




C 


D 




I 




F 






TOTAL 




no. 


I 


No. 


I 


Ho. 


1 


No. 


"I " 


No. 




No. 


I 


NO. . 


! 


Major Workbook 
Int. 

Jr. High 


49 
45 


121 
161 


49 

37 


121 
131 


74 

53 




•si 




46 

27 




> 54 


131 
151 


402 
287 


211 
151 


Teacher's Edition 
Int. 

Jr. High 


48 

31 


161 
161 


30 
10 


101 
51 


39 
41 


131 
211 


57 


(£> 


78 
66 


271 
341 


41 
47 


ft 


293 
197 


161 
111 


Skins Lesson 
Int. 

Jr. High 


27 
34 


131 
151 


46 
43 


221 
181 


42 
41 




46 

56 


221 
241 


17 
22 


81 
91 


27 
39 




205 
235 


111 
131 


iext Selection 
Int. 

Jr. High 


I* 
4 


151 
41 


35 
34 


241 
351 


10 
8 


71 
81 


32 
22 


221 
221 


31 
10 




18 
20 




149 
98 


61 
51 


Checkpoint 
Int. 

Jr. High 


5 


541 


















6 
7 


561 
1001 


11 

7 




Total 

Int. 

Jr. High 


152 
114 


141 
141 


160 
124 


151 
151 


165 
143 


161 
171 


265 
162 1 




172 
125 


151 
151 


146 
156 


Alt 
(181 > 


1060 
824 


1001 
1001 


GRAND TOTAL A^' 


266 


141 


284 


151 


308 


161 


427 


231 


297 


161 


302 


161 


1884 , 


1001 
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TABLE 3B 

ANALYSIS OF VARIANCE FOR MAIN EFFECT OF LOCATION: QUESTIONS 



Variable: 



Question 
Type 


OF 


F Value 


Significance 
of F 


Total Questions 




77.87 


.001 


Extracting Data 




37. IS 


.001 


Comparing Oata 




23.67 


.001 


Evaluating Oata 




3.07 


.02 



TABLE 2B 

ANALYSIS OF VARIANCE FOR MAIN EFFECT OF PUBLISHER: QUESTIONS 



Variable 



Question 

Type OF 


F Value 


Significance 
of F 


Total Questions 5 


27.52 


.001 


Extracting Data S 


7.92 


.001 


Comparing Data 5 


2.99 


.011 


Manipulating Oata 5 


4.16 


.001 


Evaluating Data 5 


8.72 


.001 




TABLE 18 





ANALYSIS OF VARIANCE FOR MAIN EFFECTS OF PUBLISHER: ENRICHMENT ACTIVITIES 



Variable OF F Value Significance of F 

0 

Enrichment Activities 5 13.38 .001 
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ANOVA INTERACTIONS 



TABLE 14 

ANALYSIS OF VARIANCE FOR PUBLISHER AND LOCATION 2-WAY INTERACTION: 
QUESTIONS 



Variable: m . 

Question Significance 

Type OF F Value of_F 

ToUl Questions 14 9.92 .001 

Extracting Data 13 3*25 .001 

Hanlpulatlng Data 8 3.43 -001 

Evaluating Data U 2*08 -02 



TABLE 15 

ANALYSIS OF VARIANCE FOR SCHOOL LEVEL X LOCATION 2-WAY INTERACTION: QUESTIONS 



Variable: 

Question Significance 
Type OF F Value of_F 

Total Questions 4 11.72 .001 



TABLE 13 



ANALYSIS OF VARIANCE FOR PUBLISHER AND SCHOOL LEVEL INTERACTION: QUESTIONS 

A 



Variable: 

Question Significance 

Type DF F Value of F 

Total Questions 5 4.88 .001 

Extracting Data 5 2.84 .015 

Interpreting Data 5 2.73 .02 



TABLE 16 

ANALYSIS OF VARIANCE FOR PUBLISHER, SCHOOL LEVEL, LOCATION 3-WAY INTERACTION: 
QUESTIONS 



Variable: 

Question Significance 
Type 2F F Value of_F 

*ToU1 Questions 11 4.13 .001 
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MARGINAL CELL &ANS 



TABLE 18 

MEAN NUMBER OF PUBLISHERS* QUESTIONS PER PAGE FOR QUESTION TYPES 



Variable 
guescion 
Type 


Pub. Pub. Pub. Pub. Pub. Pub. 
A 8 C 0 E F 


Average 
Over all 
Publishers 


Total Questions 


C 11 J Q 1 A oc ■» no C 07 C 17 
0.4 J 4 .01 B.tfO / .UO 9.?/ D.J/ 

(3.74) (2.78) ((.69) (4.43) (3.72) (2.29) 


79 

(4.64) 


1 C«tmrt4M flat* 

1 txiracving vaia 


i oft a 7i k 7c yT?a^ 1 11 1 Oft 
(3.63) (2.90) (4776) (477l) (2.77) (2.59) 


/l Rl I 


*^Coap*r1ng Oata 


3.74 3.45 (T7l9S<4%r> 3.63 4.04 
(3.10) (2.15) (5735) (1^7) (3.51) (2.65) 


4.22 
(3.93) 


J^Manlpul sting OaU 


2.57 1.1$ (L^rf/77) 1-90 2.33 
(1.34) ( .38) (HuT) n#) (1.26) (1.54) 


2.10 
(1.50) 


^Interpreting Oat* 


2.26 1.80 <5T38 ta.33J 2.23 2.79 
(1.73) (1.23) u!i7T(^o7) (1.90) (2.51) 


(T5D 

f?T^) 


^ Evaluating Data 


2.88 2.76 Ch97j^lo 1-32 2.03 
(1.64) (2.22)^f55) ftisi) ( .61) (1.66) 


2.54 

(1.96) 



'Standard Deviations art In Parentheses 

TfttLt 5 

MEAN NUMBER OF TOTAL QUESTIONS PER PAGE FOR PUBLISHERS A MO SCHOOL LEVEL* 



Variable Publisher Publisher Publisher Publisher Publisher Publisher 
School Level A 8 C 0 E F 



Intermediate 



C54S^ <£§P* <24i? 
JVM) (2775) {TJX) 

(TK) 



6.75 
(4.17) 



6.23 
(3.78) 





4 — f- 



5.31 
(2.03) 



Junior Hl9h 



7.49 
(4.81) 



5.69 
(3.67) 



5.82 
(2.5B) 



Standard Deviations are In Parentheses 

TABLE 4B 

MEAN NUMBER OF TOTAL QUESTIONS PER PAGE FOR PUBLISHER, LOCATION AND SCHOOL LEVEL* 



Variable 



Publisher 
A 



Publisher 
B 



Publisher 

C 



Publisher 
0 



Publisher 
E 



Publisher 
F 



Location 



INT JH 



INT JH 



INT JH 



INT JH 



INT JH 



INT JH 



Skills Lesson 



5.64 6.08 
(2.12) (3.20) 



<AA^\Zj£/ 3.56 4.44 5.31 6.79 Cj.63A3.59 ; 
*M) (Tin (752) (1.85) (2.B9) (2.21) (4.83) [T«T) 



Text Selection 



HKtit? cSiiSi &^ 



Teacher'* Manual 4.B7 3.75, (f.l*D<?7ii 



4.B7 3.75 Ct^lXL^te 
(1.60) (3.28) (XXf] (Of) 



fl 4.89JC6.79:> 5.38 3.00 5.07 4.40 \AA1S\J. 00) 
(2.66) (1.41) (2.24) (2.20) (TtTT) 



workbook 



5.40 9.9S 
(1.88) (5.00) 



<^56(0|> C^O^My 8.40 9.64 8.3" 7.92 

(rat wn) rnsf (5.41) (4.4B) (4.86) (4.97) (4.33) (Oiy (Kui 



Standard Deviations are 1n parentheses 
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TABLE 48 (continued) 

MEAN NUMBER OF EXTRACTING OATA QUESTIONS PER PAGE FOR PUBLISHER, LOCATION ANO SCHOOL LEVEL* 



Variable 


Publisher 
A 


Publisher 
8 


Publisher 
C 


Publisher 
0 


Publisher 
E 


Publisher 
F 




Location 


INT JH 


INT JH 


INT JH 


INT JH 


INT JH 
in 1 wn 


1 NT JH 




j Skills Lesson 


3.78 4.72 
(2.67) (3.21) 


2.70 2.33 
(1.57) (1.03) 




(?795) CtXS) 
\ • / \ • **** » 


cms) (T705T 


3.20 5.00 
(1.49) (0) 


3.1 


lj Text Selection 


1.00 
(0) 


2.00 3.00 
(0) (1.41) 


U. ...J 


(ttS) (TTTl) 


5.00 3.48 
(0) (12.13) 






^Teacher's Manual 


2.90 4. SO 
(1.30) (2.12) 


3.30 4.00 
(1.42) (3.16) 




3.40 1.00 
(2.30) (0) 


^uT nT5oT 


'2.67 2.00 
(1.63) (0) 




| Workbook 




6.32 5.50 
(3.06) (2.80) 




6.56 6.89 
(5.57) (5.44) 


5.52 4.07 
(3.65) (3.26) 


3.40 4.87 
(2.50) (3.11) 




• 

Standard Deviations are in part* theses 












MEAN NUNB^ Of COMPARING OATA QUESTIONS PER PAGE FOR PUBLISHER, LOCATION ANO SCHOOL LEVEL* 




Variable 


Publisher 
A 


Publisher 
I 


Publisher 
C 


Publisher 
0 


Publisher 
E 


Publisher 
F 




Location 


INT JH 


INT JH 


INT JH 


INT JH 


INT JH 


INT JH 


101 


^ Skills Lesson 


/5736 3.39\ 

V34TT05T 


2.27 1.00 
( .90) (0) 


3.00 1.33 
(2.21) ( .48) 


2.79 2.00 
(1.76) (1.33) 


3.33 2.89 
(1.75) (1.97) 


CT64 2.67^ 
(27T1) (1.50) 


Zst 


l| Text Selection 








2.10 4.<H> 
(1.73) (1.41) 


(^WJJ0JM> 
TU) TOT 




A 75 


^Teacher's Manual 


2.67 3.50 
(1.21) (3.73) 




(TfoTrriJ) 


2.47 3.00 
(2.42) (0) 


2.76 2.39 
(1.79) (1.59) 


1.75 2.00 
( .50) (0) 


Wf 


| Workbook 


3.31 5.25 
(1.70) (4.41) 


4.05 4.75 
(2.48) (1.96) 


6.51 7.44 
(6.20) (6.97) 


(OO) itot) 


5.11 5.26 
(5.73) (3.49) 


Ci i fiP<£po> 

(2.46) (TS) 





Standard Deviations are in parentheses 

MEAN NUMBER Uf MANIPULATING OATA QUESTIONS PER PAGE FOR PUBLISHER, LOCATION ANO SCHOOL LEVEL* 



Publisher Publisher Publisher Publisher Publisher Publisher 

Variable A B C 0 E F 



7 

3 
I. 



Location 


INT JH 


INT 


JH 


INT JH 


INT JH 


INT JH 


INT JH 


Tot 


Skills Lesson 


— 1.25 
... ( .50) 


1.33 
( .58) 




1.00 1.00 
(0) (0) 


2.00 1.43 
(0) ( .79) 


1.00 3.00 
(0) (2.68) 


(OS) tT*9) 




Text Selection 




1.00 
(0) 






1.67 — 
( .58) ■ 






.If 


Teacher's Manual 






2.00 
(0) 


(2.25) (2.30) 


1.25 — 
( .50) — 


1.62 1.60 
( .96) ' .69) 




/.of 


Workbook 


2.33 3.42 
(1.53) ( .91) 


1.00 
(0) 


1.00 
(0) 


n»> error 


2.30 1.74 
(1.42) ( .87). 


1.93 2.00 
(1.27) ( .70) 




1.90 



Standard Deviations art 1n Parentheses 
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TABLE 4B (continued) 

MEAN NUMBER OF EVALUATING DATA QUESTIONS PER PAGE FOR PUBLISHER, LOCATION ANO SCHOOL LEVEL* 



Variable 


Publisher 
A 


Publisher 
B 


Publisher 

C 


Publisher 
0 


Publisher 
E 


Publisher 
F 




Location 


INT JH 


INT JH 


INT JH 


INT JH 


INT JH 


INT JH 


for 


Skills Ltsson 


3.25 — 
(1.54) --- 


2.08 1.75 
(1.56) ( .89) 




2.00 1.33 
(0) ( .58) 


1.67 1.67 
(1.03) ( .58) 


(0) 


for 


Teat Stltctlon 




1.20 

— ( .45) 




2.00 2.00 
(1.00) (1.41) 


1.00 — 
(0) ™ 






Teacher's Manual 


2.88 — 
(1.64) — 


3.00 4.50 < 
(2.83) (3.54) 


(Ol) (2.04) 


3.56 2.00 
(1.67) (0) 


1.13 1.29 
( .35) ( .61) 




Xio 


Workbook 


2.71 1.00 
(1.77) (0) 


(TOS) 17775) 


TUT (3^58) 


3.00 2.00 
(2.08) ( .82) 


1.00 2.00 
(0) (0) 







Standard Deviations are 1r. parentheses 



TABLE 17 

HWN NUMBER OF ENRICHMENT ACTIVITIES PER PAGE FOR PUBLISHER 



Variable **» ,h,r wisher Publisher Publisher Overal 
p c D £ F publ , $ 

Enrichment /T42 
Activities ( 



I 

shers 



(M) (1.02) (.36) 



.09 .18 
(.34) (.72) 



ERLC 



TABLE 19 



MEAN MM Eft OF ENRICHMENT ACTIVITIES FOR PUBLISHERS AND SCHOOL LEVEL 



Varlabla 
School Level 


Publisher 
A 


Publisher 
8 


Publisher 

C 


Publisher 
0 


Publ i shir 
E 


Publisher 
F 


Intermediate 




cm 

^T" 


.36 
(1.20) 


.10 
( .36) 


.02 
( .15) 


.12 
( .37) 


Junior High 
• 


,6 




.41 

( .97) 


.32 
( .60) 


.01 
( .01) 


.06 
( .31) 



Standard Deviations are In Parentheses 
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TABLE 6 

MEAN NUMBER OF EXTRACTING DATA QUESTIONS PER PAGE FOR PUBLISHERS AND SCHOOLS* 



Variable 
School Level 


Publisher 
A 


Publisher 
B 


Publisher 
C 


Publisher 
0 


rUDi i sner 
E 


Puhl Is her 

F 


Intermediate 


(2\67) 


4.BB 
(3.00) 




(4.75) 


3.71 
(2.74) 


3.57 
(2.34) 


Junior High 


as? 


4.43 

(2.75) 


(05) 


(07) 


3.05 
(2.79) 


4.64 
(2.91) 



Standard Deviations are In Parentheses 



TABLE 7 



MEAN 



School Level A » 

a? a 



Junior High ( «;g, £{5, 



3 52 «-°° 
(2.84) (2.97) 



•suiHtard Deviations •« 1« Pirtothese* 



TABLE 8 



MEAN NUMBER 



OF MANIPULATING OATA QUESTIONS PER PAGE FOR PUBLISHER AND SCHOOL LEVEL 



Variable 
School Level 


Publisher 
A 


Publisher Publisher 
B C 


Publisher 
0 


Publisher 
E 


Publisher 
F 


Intermediate 


2.33 
(1.53) 


1.10 6xh 
( .32) Xf5G) 


1.94 
(1.16) 


1.72 
(1.10) 


T .. 


Junior High 


2.64 
(1.36) 


1.33 <24p 
( .58) (HlB) 


1.65 
( .85) 


2.06 
(1.39) 


ft? 



^Standard Deviations art In Parentheses 



TABLE 10 

MEAN NUMBER OF EVALUATING DATA QUESTIONS PER PAGE FOR PUBLISHER AND SCHOOL* 



Variable Publisher Publisher Publisher Publisher Publisher Publisher 
School Le/el A B C 0 E f 

A A A hp A 

BEST COPY AVAILABLE 



Junior High 



Standard Deviations art In Parentheses 
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